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Theoretical analyses of the random energy model with only two states and its extension with 
a hierarchy of only two levels show that these models reproduce out-of-equilibrium phenom- 
ena observed in experiments of glassy materials; the rejuvenation effect (the chaos effect), i.e. 
the abrupt jump and subsequent relaxation of the out-of-phase susceptibility as if the system 
rejuvenates when the temperature is lowered, and the power-law relaxation of the two-time 
correlation function. Our results suggest that also in an assembly of small systems with relax- 
ation times distributed broadly some of these interesting out-of-equilibrium phenomena can be 
observed. 
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§1. Introduction 

The free energy of disordered systems such as spin-glasses, structural glasses, polymers and 
proteinsB is considered to have a very complex structure with numerous local minima. Due to 
this complexity, it takes very long time for a system to equilibrate and various out-of-equilibrium 
phenomena are observed even in macroscopic time-scales.il 

For example, in the temperature cycling experiment reported for spin-glasses the relaxation 
of the out-of-phase susceptibility x" is measured in the following three stages. In the first stage, 
the sample is quenched from above T g down to a temperature T below T g and is kept at this 
temperature for a period of t\. Then the sample is perturbed by changing the temperature from T 
to T — AT and is kept at T — AT for a period of £2 (the second stage). After that, the temperature 
is returned to T in the third stage. The effect of the perturbation is examined by comparing the 
perturbed data with unperturbed data in the third stage. In the case AT > 0, both data coincide 
except at the very beginning of the third stage. This is called the memory effect, since the sample 
remembers the relaxation in the first stage. On the other hand, an abrupt jump and subsequent 
relaxation restarted as if the sample rejuvenates are observed at the beginning of the second stage, 
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which is called the rejuvenation effect or the chaos effect since it shows that equilibrium state at 
T — AT is very different from one at T, i.e. chaotic dependence of equilibrium state on temperature. 
These memory and rejuvenation effect are observed also in a cooling and reheating experiment for 



According to the Parisi's mean-field solution of the SK model, the free energy of the spin-glass has 
a very complex structure with numerous local minima. From this complex free energy landscape, 
very slow relaxation, aging, the memory effect and the rejuvenation effect can be explained by 
analyzing the random energy model and its extension.!' & 

However, some of these out-of-equilibrium phenomena are features not restricted to systems with 
numerous local minima, since it is well-known that the power-law relaxation can be reproduced 
by an assembly of small systems with very different relaxation times. Furthermore, when the 
energies of local minima deviate very strongly from valley to valley, equilibrium state, i.e. the 
Gibbs measure, is sensitive to temperature even if the number of local minima is small. Hence, 
it is expected that such small systems can show the rejuvenation effect due to this sensitivity of 
equilibrium state to temperature. The aim of this paper is to show that the rejuvenation effect 
is a feature not restricted to systems with numerous local minima and models with small number 
of local minima can reproduce the slow relaxation and the rejuvenation effect by analyzing the 
random energy model with only two states and its extension with hierarchy of only two layers. 

The organization of this paper is the following; In section 2 we present the models analyzed in this 
paper. In section 3 we show that the two-time correlation function decays in power-law. In section 
4 we show that the rejuvenation effect is reproduced by analyzing the out-of-phase susceptibility. 
Finally our conclusion and discussion about the fluctuation-dissipation theorem are presented in 
section 5. 

§2. The models 

In this section, we describe two models analyzed in this paper; the two-state random energy 
model (2S-REM) and the two-layer random energy model (2L-REM). 

2.1 The two-state random energy model 

At first we explain the 2S-REM schematically shown in Fig. 1 where only two states exists and 
the state energies E are independent random variables identically distributed as 



where T c is a parameter to express the extent of dispersion of E. From the Arrhenius law, the 



spin-glasses by Jonason et al.uP 




when E > 



otherwise 



(2.1) 



2 



(a) 



(b) 




Fig. 1. The structure of the two-state random energy model (a) and the structure of the two-layer random energy 
model (b). The closed circles represent accessible states. 



transition rate Wj from site i is related to E as 



Wi = —exp(-E/k B T). (2.2) 
to 



where tq is a microscopic time scale. From eq. (2.1), it is shown that the distribution of the 
transition rate is given as 

, . aw a ~ l when < w < 1 , 

P(w) = { ~ (2.3) 

\ otherwise, 

where a = T/T c and the microscopic time scale tq is set to the time unit. Referring to the two 
states as 1 and 2, the master equation for the probabilities Pi(t) that the system is found at the 
state i is written by the transition rates as 




d I p i(*) 1 ( -wi w 2 \ ( Pi(t) 
dt 



(2.4) 



P2{t) ) \ Wl -W 2 J \ P 2 (t) 

Furthermore, we assume that an observable, which we call the "magnetization", takes the value 
— 1(+1) when the system is in the state 1(2). 

2.2 The two-layer random energy model 

The structure of the two-layer random energy model (2L-REM) is shown in Fig. 1. We assume 
that the system is constructed by piling up the 2S-REM two times hierarchically. Consequently, 
there are four states, which we refer to as 1,2,3 and 4, where we assume that the state 1(3) is 
directly connected to 2(4). The energy of the n-th layer counted from the bottom, E n , is given 
according to the distribution p(E n ) = exp[—E n /kBT c (n)]/kBT c (n) and each layer has a different 
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T c {n) chosen so that T c (l) < T c (2). The master equation for the probabilities that the system is 
found at the state i, Pi(t), is written by the transition rates as 



I p,(t\ \ ( 



d_ 
~dt 



Pi(t) 
Ps(t) 



W\ — W\W2 
W1W2/2 

y W1W2/2 



-W\ — W\W2 
W1W2/2 
W1W2/2 



W3W4/2 
W 3 W4,/2 

-W3 — W3W4 
w 3 



W3W4/2 
W3W4/2 

w 3 

-W3 - W3W4 ) 



P2(t) 



(2.5) 

where w\ and w 3 denotes the transition rates from lower layer to upper layer and u>2 and W4 denotes 
the transition rates between different branches. From the distribution of the state energy p(E n ), 
w\ and w 3 distributes as airo" 1-1 where ol\ = T/T c (l) and W2 and W4 distribute as a2W a2 ~ 1 where 
0L2 = T/T c (2). Finally, we assume that the magnetization takes the values — 1 — e, — 1 + e, 1 — e and 
1 + e when the system is in states 1, 2, 3 and 4. 

§3. The long-time behavior of the two-time correlation function 

In this section we analyze the two-time correlation function of the "magnetization" for the two 
models. We assume that the initial conditions are given as 



P^O) = P 2 (0) = 1/2 for 2S-REM, 
P x (0) = P 2 (0) = P 3 (0) = P 4 (0) = 1/4 for 2L-REM, 

to see the relaxation after quench from infinitely high temperature to T below T c 



(3.1) 
(3.2) 



3.1 2S-REM 

At first, we calculate the correlation function for the 2S-REM. The master equation eq. ([2.4D is 
solved exactly and the solution is given by 

(wi - w 2 ) exp[— (wi + w 2 )t] + 2w 2 



Pl(t) - 
Pi(t) 



2(wi + w 2 ) 
(w 2 - wi) exp[— (wi + w 2 )t] + 2wi 



2{wi + u) 2 ) 

The conditional probabilities Gij(t) that the system is found at the state i at time t if the system 
is at the state j at time are given by 

wi exp[— (wi + 102)*] + w 2 



G n (t) : 
G 12 (t) = 
G 2 i(t) = 

G 22 (t) 



Wi + W 2 

-W2exp[— (wi +w 2 )t] +w 2 

Wi + W 2 

-W\ exp[— (w\ + w 2 )t\ + w\ 

W\ + U>2 

w 2 exp[— (wi + w 2 )t] + wi 
wi + w 2 
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With these quantities, the two-time correlation function C(t,t') of the magnetization is written as 

C(M') = J2 mim i < Gi i( t ~ t ') p j( t ') >> ( 3 - 3 ) 

i,j 

where the angle bracket denotes average over distribution of the jump rates and rrii denotes the 
magnetization of the state i. 

It is shown that when t >> l(the time unit is to) 

w ™ w % exp[-(wi + «; 2 )t]\ ~ — a T{a + m)T{a + n)r 2a , (3.4) 



, (w\ + W2) 2 v 1 ' ^" J /-2(2a + l 

by using the asymptotic form of the incomplete gamma function 7(0 + m, t) ~ T(a + m) — 
i a + m_1 exp(— t). Consequently, using eq. (|3.4j) , when t,t',t — t' » 1 the correlation function 
is written as 

C(t, t') ~ A[t- 2a - t'~ 2a + 2a(t - t')~ 2a ] + B, (3.5) 

where A = a 2 T (a) 2 / (2a + l),B =< (w\ — w 2 ) 2 /(wi + W2) 2 >■ This expression of the two- 
time correlation function implies that the out-of-equilibrium effect, i.e. the dependence on t 1 , 
persists after very long time and the equilibrium relaxation follows the power-law with the exponent 
-2T/T C . 

3.2 2L-REM 

Next, we calculate the correlation function for the 2L-REM. From the symmetry of the proba- 
bilities and the conditional probabilities; 

P 1 (t) = P 2 (t) = P-(t),P 3 (t) = P A (t) = P + (t), 
G l2 (t) = G 21 (t) = G—(t),G M (t) = G43® = G++(t), 
G u (t) = G 22 (t) = r__ (t), G 33 (t) = Gu(t) = r++(t), 
G 31 (t) = G 32 (t) = G 4 i(t) = G 42 (t) = G+-(t), 
G 13 (t) = G u (t) = G 23 (t) = G 24 (t) = G_+(t), 

the correlation function is rewritten in terms of the probabilities and the conditional probabilities 
defined above, P-(t),P+(t),G ++ (t),r ++ (t),G+-(t),G-+(t), as 

C(t,t') = 4(1 + e 2 ) < r__(i - t')P-(t') > + 4(1 - e 2 ) < G—(t - t')P-(t') > 

-8 < G- + (t-t')P + (t') > . (3.6) 



By solving the master equation eq. fl2.5|) , the following expressions for the probabilities and the 
conditional probabilities are given; 

(wiw 2 — W3W4) exp[— (wiw 2 + w^w^)t\ + 2w 3 W4 



P-(t) 



A(wiW 2 + ^3^4) 
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, , _ — {w\W 2 - W3W4) exp[-(w\W2 + W3W4,)t] + 2WIW2 

Jr ^+\ t ) ~ 77 ; \ ' 

r— (t) = - exp -iwi (2 + w 2 )t\ + — ■ r , 

2 2{w\w 2 + W3W4) 

1 u> 3 u> 4 + u>iu> 2 exp[-(u> 1 u;2 + ^3^4)*] 
G__ t) = --exp [-w 1 (2 + w 2 )t + , 

2 2(tuiu;2 + W3W4) 

_ W3W4 - W3W4 exp[-(wiW 2 + W3W4)*] 

By using the following expressions; 

< exp(- Wl w 2 t) >= aia2 [T(a 2 )-T(a 2 ,t)]t'^ - Ql " 2 [T(ai) - r(a 1; t)]t~ ai (3.7) 
ai — 02 «i — «2 

and for large t, t' 

{ t\~ a ' 2 /■*'/* x a2_1 
< exp(-2wi< - wiwaf) >~ aia 2 r(ai)t Ql ^-J ^ dx (2 + x)"i ' ^' 8 ' ) 

when t, if , t — t' are large the correlation function is consequently given as 

C(M') = «l«2r(« 2 ) 2 n_ 2a2 _ i ,-2a 2 + _ t y2a 2] + _ ft- ai 

a 2 (2a 2 + l)(ai - a 2 ) 2 

+ / K W2 -W \ + Q 

\ (Wl1tf 2 + ^3^4) / 

where c is a function of parameters, cti and a 2 , defined as 

- ais~ ai ~ 1 [r(ai) - r(ai, a)]}. (3.10) 

This asymptotic form implies that when 2a 2 < «i 4- e - 2T C (1) < T c (2), the dynamics in the 
upper layer of the hierarchy is dominant and the asymptotic form is same as that of the 2S- 
REM except for the difference of constants since the leading term of eq. (3.9) is proportional to 
[t~ 2a2 - t'- 2a2 + 2a 2 (t - t')~ 2a2 ]. On the other hand, when 2T C (1) > T c (2) the long-time behavior 
is governed by the dynamics in the lower layer, since the leading term of eq. (3.9) is proportional 
to (t - t')- ai . 

§4. The out-of-phase susceptibility and the rejuvenation effect 

In this section we show that the 2S-REM and 2L-REM reproduce the rejuvenation effect, which is 
the abrupt jump and subsequent relaxation of the out-of-phase susceptibility when the temperature 
is lowered. 

We explain the definition of the out-of-phase susceptibility. Assuming that the magnetization 
when the system is at the state i is rrii and h{t) denotes the applied "magnetic field" at time t, 
the state energy is changed by —mih(t) and the transition rate from the state i is modified by the 
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factor exp[—mih(i)/kBT]. Then the magnetization at time t is given by 

m(t) = Y d m i P i {t). 

i 

We assume that the applied magnetic field oscillates in time as 

h(t) = he'™ when t > 0. 
Then the out-of-phase susceptibility \" is defined as the imaginary part of the susceptibility 



(4.1) 



(4.2) 



X(u,t) = lim 



m(t) 



(4.3) 



/i— he- iut ' 

We observe the out-of-phase susceptibility defined in this way in the following temperature vari- 
ation protocol; In the first stage, the sample is quenched at time from infinitely high temperature 
to a temperature T below T c and the oscillating magnetic field is applied at the same time. After 
that, the sample is kept at the temperature T for a period of t\. In the second stage, the temper- 
ature is changed from T to T — AT and is kept at the same value for a period of ■ Fig. 2 shows 
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Fig. 2. The out-of-phase susceptibility of the two-state random energy model (T c = 1) when the temperature is 
lowered at t = 500 from T = 0.48 to T = 0.28 (the solid line) and from T = 1.0 to T = 0.8 (the dashed line). 
The frequency a; is 0.1 and the out-of-phase susceptibility is averaged over 100 samples. The abrupt jump and the 
subsequent relaxation, i.e. the rejuvenation effect, is clearly seen when the temperature is low. 



the result of numerical calculations for 2S-REM when T = 0.48 and T = 1.0, AT = 0.2, ti = 500. 
We can clearly see the rejuvenation effect when T = 0.48, i.e. the abrupt jump and the subsequent 
relaxation of the out-of-phase susceptibility when the temperature is changed. After the jump, 
x"(oj,t) relaxes to the new steady-state value at the temperature T — AT with oscillation. As 
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derived in Appendix, the steady-state value when the frequency u is low compared to tq behaves 
as 



when a > 1/2 



(4.4) 



lim x"(u;,i) 

1 -^ T 4Aa 2 r(-2a)sin(7ra)o; 2Q when a < 1/2, 

where the definition of the constants A and B are given in eq. ( |3.5[ ), This result implies that the 
behavior of the steady-state value changes when a = 1/2. The qualitatively same result for the 
2L-REM is given in Fig. 3. 
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Fig. 3. The out-of-phase susceptibility of the two-layer random energy model (T c (l) = 0.4, T c (2) = 1.0) when the 
temperature is lowered at t = 500 from T = 0.48 to T = 0.28 (the solid line) and from T = 1.0 to T = 0.8 (the 
dashed line). The frequency u> is 0.1 and the out-of-phase susceptibility is averaged over 100 samples. The abrupt 
jump and the subsequent relaxation, i.e. the rejuvenation effect, is clearly seen when the temperature is low. 



As shown in Fig. 2 and Fig. 3, the rejuvenation effect is clearly seen when the temperature is low. 
We show that the abrupt change becomes steep when the temperature is low or the disorder of the 
state energy is strong, which is the consequence of sensitivity of equilibrium state to temperature. 
Since the qualitative behavior of the out-of-phase susceptibility of the 2S-REM is same as that of 
the 2L-REM, we consider the 2S-REM for simplicity. Since the time lapse of the first stage, t±, is 
sufficiently long, the system is at the steady state. By solving the master equation when h is small, 
the probability distribution of the steady state at the temperature T is derived to the order O(h) 
as 

2w 1 w 2 exp(-iut 1 ) / 1 , ( _ } 





W1+W2 \ w\ J k B T(w\ + w 2 )(ioj - wi - W2) \ -1 
From this expression and the master equation eq. (|2.4[), the time derivative of the out-of-phase 
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susceptibility immediately after the change of the temperature is given by 

7 a r I T/ (T— AT) T/(T-AT) ] 

X K*i ) = lim —x (w,i) - tt^ 7 ; N3 

t\ti at /cbT (wi + f^j 



-a; 



(4.6) 



where w\ and 1^2 are the jump rates before the temperature is changed and we assume that the 
frequency to is low. Assuming that the temperature variation AT/T is small, the time derivative 
of disorder-averaged x" is given to the order 0(AT/T) as 



./// 8U> / WlWO lOg W\ \ , r~r~i I r~r~i 



(4.7) 



A:_bT \ (wi + W2) 3 1 

The result of numerical calculation of the expression eq. (|4.7| ) is given in the Fig. 4. We see that 
the time derivative, < ^"(u;,^) >, is a monotonously increasing function of T c /T. Since the 
deviation of the state energy is a monotonously increasing function of T c , the above result implies 
that the abrupt change of the out-of-phase susceptibility becomes steep when the disorder of the 
state energy is strong or the temperature is low. 
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Fig. 4. The T c -dependence of the speed of the change of the out-of-phase susceptibility when the temperature is 
lowered slightly. This plot shows that the speed is a increasing function of T c /T and the abrupt change of the 
out-of-phase susceptibility becomes very steep when the state energy deviates broadly or the temperature is low. 



§5. DISCUSSION AND CONCLUSIONS 

Summarizing our result, we have considered the out-of-equilibrium behavior of the two-state 
random energy model (2S-REM) and its extension with a hierarchy of two levels, i.e. 2L-REM. 
We have shown that these models of energy landscape with very small number of local minima 
can reproduce the out-of-equilibrium phenomena observed in glassy materials, especially the re- 
juvenation effect due to sensitivity of equilibrium state to temperature. It suggests that some of 
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the interesting phenomena observed in glassy materials can be observed in an assembly of small 
systems with relaxation times distributed broadly even if the number of local minima is small. 

We close by discussing a future issue to be solved in terms of the rugged free-energy landscape 
picture. Recently, it has been found that the phenomenological models based on the rugged free- 
energy landscape picture can explain at least qualitatively many of significant dynamical properties 
of the glassy materials. BH* However, there is an exception; violation of the fluctuation-dissipation 
theorem described with the violation ratio X(t,t') = kBTR(t,t')/dt'C(t,t'), where R(t,t') denotes 
the response function, observed in spin-glasses and other glassy materials. BH* For example, it is 
easily shown for the models analyzed in[5],|6|) that the violation ratio X(t, if) is given as X(t, t') = t/t' 
from the scaling of the correlation function C(t,t') = C(t/t') and the relation known to hold for 
these models (kBTR(t,t ! ) = — dtC(t, t'))® Hence, these models cannot reproduce the constant 
violation factor observed in the p-spin spherical spin-glasses and in the numerical studies of the 
structural glasses.^ It would be interesting to create a phenomenological model with the rugged 
free-energy landscape picture be able to reproduce violation of the fluctuation-dissipation theorem 
in order to understand the physical meanings of the violation factor X(t,if)$ l 
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Appendix: derivation of the steady-state value of the out-of-phase susceptibility 

Here, we evaluate the steady-state value of the out-of-phase susceptibility. We start with the 
expression of the susceptibility x( w >0 i n terms of the response function R(t,t'); 

X(u,t)=[ dt'R(t,t')exp[iuj(t-t')}. (A-l) 
Jo 

Noting that the asymptotic form of the correlation function is given in eq. (|3.5| ) and the response 
function is given by the time derivative of the correlation function, i.e. —dtC(t,t')/kBT, when the 
dynamics for the REM is trap type, i.e. eq. (p^),B we can evaluate the steady-state value of the 
susceptibility from eq. ([A-l]). 



At first, we divide the right hand side of eq. (A-l) into two parts as 



X(p>,t)= [ dt'R{t,t')e iu)it - tn > + / dt'Rfat'y^*-^, (A-2) 
Jo Jt-t 1 - b 

where we assume < b < 1. By using the relation kBTR(t,t') = —dtC(t,t') and the asymptotic 
form of the correlation function, eq. (|3.5| ), we can evaluate the first term as 

|the first terml < M^M^-i) _ r 2a-6i (A . 3) 
k B T 

Hence, the first term becomes in the long time limit, t — > oo. Next, we evaluate the second term. 
Since t — if <C if in the region of the integration, the time translational invariance holds, i.e. R(t, if) 
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is the function of the time difference t — t'. Rewriting the response function as R{t — t'), the second 
term is given as 

rt dt'Rit - t'y^-^ = C 

it-t 1 - b Jo 



the second term = / dt' R(t - t'y^'^ = dT R(r )e' WT . (A-4) 

Jt-t 1 - b Jo 



Hence, the second term becomes in the long time limit Jq°° dTR(T)e tu3T . Gathering these results, the 
out-of-phase susceptibility is given in the long time limit as 

lim t) = f°° drR(r) sin^r) = __L f° dr^^ sin^r). (A-5) 

Jo kbT Jo dr 

Then, noting that the decay of the correlation function C(r) is faster than 1/r when a > 1/2 and 
is slower than 1/r when a < 1/2, by using the asymptotic form of the correlation function eq. ( |3.5[ ) 
we reach the expression eq. 
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